Papers with deep learning methods
Copied to clipboard
| Challenge: | Named entity recognition (NED) is a method for identifying named entities within a knowledge base. |
| Approach: | They propose a method for individual identification requiring few annotated data samples. |
| Outcome: | The proposed method is well-motivated for integration in real systems. |
Copied to clipboard
| Challenge: | Efficient access to mentions of clinical entities is very important for using clinical text. |
| Approach: | They developed a pipeline system based on deep learning methods for this shared task . it achieves a micro-average F1-score of 0.9105 on track 1 and a mini-average LSTM score of 0.8391 on track 2 . |
| Outcome: | The proposed system achieves a micro-average F1-score of 0.9105 on track 1 and a mini-average score of 0.8391 on track 2. |
Copied to clipboard
| Challenge: | This tutorial aims to introduce graph-based deep learning techniques such as Graph Convolutional Networks (GCNs) for Natural Language Processing (NLP) |
| Approach: | It provides a brief introduction to graph-based deep learning techniques such as Graph Convolutional Networks (GCNs) for Natural Language Processing (NLP). |
| Outcome: | This tutorial provides a brief introduction to graph-based deep learning techniques such as Graph Convolutional Networks (GCNs) for natural language processing (NLP). |
Copied to clipboard
| Challenge: | Currently, the number of biomedical literature is growing at an exponential rate. |
| Approach: | They propose a Deep Learning architecture for pharmaceutical and chemical Named Entity Recognition in Spanish clinical cases texts. |
| Outcome: | The proposed model outperforms the state-of-the-art methods on the PharmaCoNER corpus . the proposed model is based on two bidirectional long-term memory and conditional random field networks . |
Copied to clipboard
| Challenge: | Existing methods for mental illness detection have limited data available for training . lack of sufficient annotated data and inability to extract explanations on the derived outcome have restricted researchers to use traditional methods. |
| Approach: | They propose to use emotional patterns identified by clinical practitioners to enhance the prediction capabilities of a mental illness detection model built using a deep neural network architecture. |
| Outcome: | The proposed method achieves a task-specific AUC higher than 0.90 . it compares multi-task learning with multi-channel convolutional neural network and multiple inputs to methods such as multi-class classification . |
Copied to clipboard
| Challenge: | Recent advances in machine reading have inspired researchers to combine Information Retrieval with machine reading to tackle open-domain QA. |
| Approach: | They propose two neural network rankers that assign scores to different passages based on their likelihood of containing the answer to a given question. |
| Outcome: | The proposed models achieve human level performance in open-domain QA compared to reading comprehension-style QA because it is difficult to retrieve the pieces of paragraphs that contain the answer to the question. |
Copied to clipboard
| Challenge: | Antimicrobial resistance is a growing global health threat, driving interest in nanoparticle-based alternatives to conventional antibiotics. |
| Approach: | They propose to use machine learning to classify scientific abstracts using inorganic nanoparticles with intrinsic antibacterial properties. |
| Outcome: | The proposed method distinguishes intrinsic antibacterial NPs from studies focusing on drug carriers or surface-bound applications. |
Copied to clipboard
| Challenge: | Short text classification is a problem in natural language processing, social network analysis, and e-commerce. |
| Approach: | They propose a short text classification technique that incorporates label dependencies into the output space to overcome the limitations of short text. |
| Outcome: | The proposed model outperforms baseline methods on proprietary and external datasets and is more robust to noise in textual features. |
Copied to clipboard
| Challenge: | This paper is the first to use deep learning methods to solve Arabic MWPs . it is also the first study to use transfer learning to solve MWp across different languages . |
| Approach: | They contribute to the first large-scale dataset for Arabic Math Word Problems . they use deep learning methods to solve Arabic MWPs and a transfer learning model to promote performance . |
| Outcome: | The proposed model improves Arabic MWP solvers by 3% over the existing model. |
Copied to clipboard
| Challenge: | Existing methods for sentiment analysis are inconsistent and require manual processing. |
| Approach: | They use natural language processing and machine learning to classify Yelp reviews' sentiments. |
| Outcome: | The proposed model outperforms other models on Yelp reviews. |
Copied to clipboard
| Challenge: | Traditionally, data-to-text applications have been designed using a modular pipeline architecture, in which the non-linguistic input data is converted into natural language through several intermediate transformations. |
| Approach: | They propose to use Gated-Recurrent Units and Transformer to implement neural pipelines for data-to-text generation. |
| Outcome: | The proposed models generalize better to unseen inputs and have better performance than the existing pipeline architectures. |
Copied to clipboard
| Challenge: | Existing methods for toxic language detection are based on deep learning, but they are not scalable considering inference speed and computational resources. |
| Approach: | They propose a method for toxic language detection that is aware of real-world scenarios by partial stacking partial stacks that feeds initial results with low confidence to meta-classifier. |
| Outcome: | The proposed method achieves faster inference speed than BERT-based models with comparable performance. |
Copied to clipboard
| Challenge: | Existing methods to apply large language models to zero-shot next location prediction tasks are limited due to their limited computational power. |
| Approach: | They propose a systematic agentic prediction framework to achieve generalized next location prediction. |
| Outcome: | The proposed framework surpasses the leading baseline by 3.33% to 8.57% across 8 out of 12 metrics. |
Copied to clipboard
| Challenge: | Existing models for machine reading comprehension use word and character representations, but character is not the minimal unit. |
| Approach: | They propose to use subword rather than character for word embedding enhancement . they also empirically explore different augmentation strategies on subword-augmented embedded embedders . |
| Outcome: | The proposed model outperforms state-of-the-art models on public datasets. |
Copied to clipboard
| Challenge: | Literature is artistic and conveys complex themes over the course of very long narratives. |
| Approach: | They propose a method which can work with large literary corpus of texts . they propose 'gutenberg' dataset to perform Genre Identification . |
| Outcome: | The proposed methods improve results in a literature-based task with 200,000 words of literature . the Gutenberg dataset is used to model literary classifications with a high level of fidelity . |
Copied to clipboard
| Challenge: | Existing methods to document classification in low-resource languages are under-resourced . 6% of the world's languages are spoken, and many have inadequate resources . |
| Approach: | They propose a meta-learning approach to document classification in low-resource languages . they propose 'nuclear-shot' cross-lingual adaptation to previously unseen languages based on limited data . |
| Outcome: | The proposed method performs on-par on some languages while under-resourced in others. |
Copied to clipboard
| Challenge: | stance detection is a method to determine the attitude of a text with respect to a specific topic or claim. |
| Approach: | They propose a multilingual dataset for stance detection in Twitter for the Catalan and Spanish languages. |
| Outcome: | The proposed dataset shows that it is well balanced for multilingual and cross-lingual research. |
Copied to clipboard
| Challenge: | a recent shift towards expressive emotion representation models has hampered deep learning in sentiment analysis. |
| Approach: | They propose a multi-task learning problem to solve a language data bottleneck . they propose to use word emotion induction as an individual task to predict emotion . |
| Outcome: | The proposed model outperforms a wide range of other methods on 9 languages and 15 conditions. |
Copied to clipboard
| Challenge: | Existing deep learning methods for answer selection are not feature engineering or expensive external resources. |
| Approach: | They propose to use deep learning methods to analyze and predict answer quality . they use a set of candidate answers to identify which of the candidates answers the question correctly. |
| Outcome: | The proposed methods produce impressive performance without feature engineering or expensive external resources. |
Copied to clipboard
| Challenge: | Using linguistic content and vocal characteristics for multimodal deep learning is difficult for computers to interpret human meaning . |
| Approach: | They propose a deep multimodal network with feature attention and modality attention to classify utterance-level speech data. |
| Outcome: | The proposed system achieves state-of-the-art or competitive results on three published multimodal datasets. |
Copied to clipboard
| Challenge: | Emotion analysis of text is increasing in popularity in NLP, however, manually creating lexica for psychological constructs such as empathy has proven difficult. |
| Approach: | They compare different approaches to learning word ratings from higher-level supervision and use a Mixed-Level Feed Forward Network to create the first-ever empathy lexicon. |
| Outcome: | The proposed model automatically creates empathy word ratings from document-level ratings. |
Copied to clipboard
| Challenge: | Ghosting is a type-ahead completion task that predicts a user's intended input for inline query auto-completion (QAC). |
| Approach: | They propose to use ghosting to predict a user's intended input for inline query auto-completion by suggesting completions to incomplete queries. |
| Outcome: | The proposed method outperforms deep learning and deep learning methods with and without dialog context for ghosting. |
Copied to clipboard
| Challenge: | a weak supervision approach is a promising tool for learning discourse structure for multi-party dialogue. |
| Approach: | They propose a data programming paradigm that allows a user to label training data using expert-composed heuristics and transform them into probability distributions of the class labels. |
| Outcome: | The proposed approach outperforms both deep learning and traditional ML approaches on the task of learning discourse structure for multi-party dialogue. |
Copied to clipboard
| Challenge: | Existing word embedding methods do not learn numeral embedds well because numerals are limited in number and their appearances in training corpora are highly scarce. |
| Approach: | They propose two numeral embedding methods that can handle the out-of-vocabulary problem for numerals. |
| Outcome: | The proposed methods can handle the out-of-vocabulary problem for numerals. |
Copied to clipboard
| Challenge: | ad-hoc information retrieval methods usually require large amounts of annotated data to be effective. |
| Approach: | They propose an open-source toolkit to automatically build large-scale English information retrieval datasets based on Wikipedia. |
| Outcome: | The proposed toolkit builds large-scale English information retrieval datasets based on Wikipedia with 59,252 queries and 2,617,003 pairs. |
Copied to clipboard
| Challenge: | a recent study shows that definition extraction is inefficient for one-sentence definitions . definitions are used in many automatic text analysis tasks, including ontology matching and construction . |
| Approach: | They propose to use convolutional neural network and recurrent neural network to identify mathematical definitions from one sentence. |
| Outcome: | The proposed dataset shows that deep learning methods can identify definitions from mathematical texts. |
Copied to clipboard
| Challenge: | Existing tools for automatic translation of sign language videos into transcribed texts are limited. |
| Approach: | They propose to use deep learning methods to circumvent the use of models in spatial referencing recognition by a 3D skeleton and a software program to capture and post-process the LSF-SHELVES corpus. |
| Outcome: | The proposed system targets iconicity and spatial referencing in french sign language . it is light-weight and low-cost to collect data from a large panel of signers . |
Copied to clipboard
| Challenge: | Discourse markers carry information about the discourse structure and organization, and also signal local dependencies or epistemic stance of speaker. |
| Approach: | They propose an ISO-based annotated multilingual parallel corpus for discourse markers . they propose an annotation scheme for discourse relations with a plug-in to ISO 24617-2 . |
| Outcome: | The proposed language resource is based on an ISO-based annotated multilingual parallel corpus of discourse markers. |
Copied to clipboard
| Challenge: | Existing methods to assess lexical complexity are used to evaluate the difficulty of vocabulary for language learners. |
| Approach: | They propose to use pre-trained language models to assess the complexity of a word based on its context. |
| Outcome: | The proposed method outperforms the best systems in SemEval-2021. |
Copied to clipboard
| Challenge: | lexico-semantic elements capture a large amount of linguistic information, but they do not capture all information contained in text. |
| Approach: | They propose to use BERT to train a model that uses a deep bidirectional transformer to capture a significant amount of lexico-semantic information. |
| Outcome: | The proposed model captures lexico-semantic information, but it is redundantly encoded in lexical information. |
Copied to clipboard
| Challenge: | Existing semantic parsers are based on deep learning, but rule-based approaches offer advantages . a drawback of neural semantic parses is that their output lacks explainability . |
| Approach: | They propose a method that maps a syntactic dependency tree to a formal meaning representation using a series of graph transformations. |
| Outcome: | The proposed method outperforms neural parsers in English, German, Italian and Dutch. |
Copied to clipboard
| Challenge: | censorship is a potential risk when addressing these issues with automated text classification methods. |
| Approach: | They propose to use a neural network-based ensemble method to better classify hate speech using a publicly available embedding model and a popular sentiment dataset. |
| Outcome: | The proposed method improves by 5 points on a hate speech corpus from Twitter and a popular sentiment dataset. |
Copied to clipboard
| Challenge: | Existing methods for word sense disambiguation (WSD) are limited and require large datasets annotated with word senses. |
| Approach: | They propose a meta-learning framework for few-shot word sense disambiguation where the goal is to learn to disambiguate unseen words from only a few labeled instances. |
| Outcome: | The proposed framework is based on a large training dataset and a small number of examples. |
Copied to clipboard
| Challenge: | We train monolingual and cross-lingual classifiers on the extracted features of tweets . we use a few state-of-the-art contextual embeddings to extract features of the tweets. |
| Approach: | They propose to use tweets to train a dataset of English and two low-resource languages to train zero-shot transfer models. |
| Outcome: | The proposed model performs well in English and in low-resource languages . the proposed model is based on state-of-the-art embeddings and semi-supervised methods . |
Copied to clipboard
| Challenge: | a traditional approach to corpus building involves constructing a corpus centered around specific themes, such as colors. |
| Approach: | They propose to use deep learning methods to accelerate corpus building in humanities . they propose to integrate metadata embeddings into the model to improve accuracy . |
| Outcome: | The proposed method outperforms token-based searches in the humanities and linguistics field. |
Copied to clipboard
| Challenge: | Existing work on fake news detection is limited due to the complex nature of the news . |
| Approach: | They propose a statistical approach for the generation of feature vectors to describe a document . they use class label frequency distance to boost machine learning methods . |
| Outcome: | The proposed method outperforms deep learning methods in large datasets while outperforming traditional methods. |
Copied to clipboard
| Challenge: | Where someone looks is a nonverbal communication cue that children and adults readily use. |
| Approach: | They used 1,360 real-world photos to construct evaluation stimuli for Vision-Language Models (VLMs) they found a substantial performance gap between VLMs and humans . |
| Outcome: | The proposed model outperforms existing models in predicting gaze direction using head orientation rather than eye appearance. |
Copied to clipboard
| Challenge: | Existing methods for enhancing training data are limited in natural language tasks due to text characteristics. |
| Approach: | They propose a data augmentation method that softly augments a randomly chosen word in a sentence by its contextual mixture of multiple related words. |
| Outcome: | The proposed method outperforms baseline methods on small and large scale machine translation datasets. |
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) and Named Enel Linking (NEL) are two related tasks that are under-resourced for the Slavic languages. |
| Approach: | They propose to use deep learning methods to improve a Named Entity Recognition corpus and to predict and annotate new types in a test corpus. |
| Outcome: | The proposed model improves a type-based Named Entity Recognition (NER) training corpus and predicts and annotates new types in a test corpus. |
Copied to clipboard
| Challenge: | Existing deep learning methods require large datasets to achieve high generalizability. |
| Approach: | They propose a framework that enhances deep learning models with clinical rationales derived from medically proficient Large Language Models. |
| Outcome: | The proposed framework outperforms state-of-the-art models on two tasks using two popular EHR datasets by up to 11.2%. |
Copied to clipboard
| Challenge: | Existing methods for opinion mining and sentiment analysis focus on extracting either positive or negative opinions from texts and determining the targets of these opinions. |
| Approach: | They propose a corpus-based scheme that detects evaluative language at a finer-grained level. |
| Outcome: | The proposed scheme classifies each sentence into one of four evaluation types based on the proposed scheme. |
Copied to clipboard
| Challenge: | Aspect Based Sentiment Analysis (ABSA) is a finer level sentiment analysis that assigns polarity to each targeted aspect instead of the entire review. |
| Approach: | They propose to use Telugu as a language for aspect based sentiment analysis . they use a resource that can be used to classify and categorise aspects of a review . |
| Outcome: | The proposed resource is based on a set of tasks in Telugu which demonstrate its reliability and usefulness. |
Copied to clipboard
| Challenge: | Recent studies show improvements in stance detection by using attention mechanism or sentiment information. |
| Approach: | They propose a multi-task framework that incorporates attention mechanism and takes sentiment classification as an auxiliary task. |
| Outcome: | The proposed model outperforms state-of-the-art deep learning methods on the SemEval-2016 dataset. |
Copied to clipboard
| Challenge: | Recent advances in pretrained contextual representation models have made significant progress on a number of different English NLP tasks. |
| Approach: | They propose a robust framework to include unlabeled non-English samples in the fine-tuning process of pretrained multilingual representation models. |
| Outcome: | The proposed framework includes unlabeled non-English samples in the fine-tuning process of pretrained multilingual representation models. |
Copied to clipboard
| Challenge: | Recent advances in deep learning methods for natural language processing (NLP) have created new business opportunities and made NLP research critical for industry development. |
| Approach: | They examine industry presence in the field since the early 90s and characterize it using a corpus of 78,187 NLP publications and 701 resumes of NLP publication authors. |
| Outcome: | The authors find that industry presence among NLP authors has been steady before a steep increase over the past five years (180% growth from 2017 to 2022). |
Copied to clipboard
| Challenge: | Objective questions such as fill-in-the-blank and multiple-choice require examinees to select one valid answer from a set of invalid options. |
| Approach: | They examine distractor generation tasks, datasets, methods, and evaluation metrics for English objective questions. |
| Outcome: | The proposed task is based on fill-in-the-blank and multiple choice questions and is widely utilized in educational settings across various domains and subjects. |
Copied to clipboard
| Challenge: | Recent surge in deep learning technologies has significantly accelerated research in this area. |
| Approach: | They propose a comprehensive summary of the relevant tasks in geometry problem solving and a review of related deep learning methods. |
| Outcome: | The proposed method is based on a systematic review of related methods and evaluation metrics and methods. |